CONTENTS TABLE 



NAME 


SOURCE 


SUB-SOURCE 


TIME (OPTIONAL) 


CNN 


SETJOP.BOX 


CHANNEL 15 


ALWAYS 


1 LOVE LUCY 


SET_TOP_BOX 


CHANNEL 16 


M-F 8:00-8:30 AM 



ABC 


TVJ 


CHANNEL? 


ALWAYS 








\ 




FIG. 3 


80 



TOPOLOGY TABLE 

CONNECTIONS ^ 
SET_TOP_BOX.VIDEOOUT-> TV1 .VIDEOIN 



VCR.VIDE00UT->TV1 .AUXIN 

FIG. 4 90 



RECEIVE VERBAL 
COMMAND 



-600 



DETERMINE DESIRED ACTIVITY, SOURCE 
CONTENT, AND TARGET DEVICE 




^602 




^604 






608 
/ 


NO 


ERROR; PROMPT USER 
FOR INSTRUCTIONS 





ADD SOURCE DEVICE FILTER TO FILTER GRAPH 



DETERMINE THE NEXT DEVICE FILTER TO ADD 



-610 
-612 



ADD NEXT DEVICE FILTER 



-614 



CONNECT PINS AND NOTIFY DEVICE FILTERS 



-616 




622 



ERROR; PROMPT USER 
FOR INSTRUCTIONS 



FIG. 6 



*1l 




ALTERNATE DEVICE FILTERS TABLE 



NAME 


PINS 


LOCATION 


SET_TOP_BOX 


PIN1 


LIVING ROOM 


VCR 


PIN2.PIN3 


LIVING ROOM 


• 
• 
• 


TVJ 


PIN4, PINS 


LIVING ROOM 




FIG. 8 


\ 

100 



ALTERNATE PINS TABLE 



PIN ID 


PIN IDENTIFIER 


MEDIA 
TYPE 


MEDIUM 


SUPPORTED 
FUNCTIONS 
(ACTIVITY VERBS) 


FLOW 
TYPE 


PIN1 


SET_TOP_BOX.VIDEOOUT 


VIDEO 


M1 


WATCH 


OUTPUT 


PIN2 


VCR.VIDEOIN 


VIDEO 


M3 


RECORD 


INPUT 


PIN3 


VCR.VIDEOOUT 


VIDEO 


M2 


PLAY 


OUTPUT 



PIN4 


TV.I.VIDEOIN 


VIDEO 


M1 


WATCH 


INPUT 


PINS 


TV_1.AUXIN 


VIDEO 


M2 


WATCH 


OUTPUT 



FIG. 9 



